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METHOD AND APPARATUS FOR PERFORMING A SEARCH 

[0001] This application claims the benefit of U.S. Provisional Application No. 
60/520,845 filed on November 18, 2003, which is herein incorporated by 
reference. 

[0002] The present invention relates to a method and apparatus for assisting a 
user in performing a search. More specifically, the present invention relates to 
a novel approach that applies transaction and/or click records to assist a user in 
narrowing or focusing a search. 

BACKGROUND OF THE INVENTION 
[0003] With the proliferation of vast amount of information on the Internet, it is 
often very difficult to search and locate relevant information without having to 
first expend a great deal of time to peruse over many irrelevant search results. 
Depending on the material that is being sought, the user is often frustrated by 
having to view many immaterial search results. 

[0004] One difficulty in searching for relevant information on the Web is that the 
user is often not using the most relevant search term(s). For example, a user 
may enter very general terms such as "Sony" or "shoes" and the like. Such 
general terms often produce a very large number of search results. The 
results are not particularly focused and often require a substantial amount of 
filtering by the user, where the user may have to enter additional narrowing 
terms. Unfortunately, the reason that the user may have started the search 
with a very general term could very well be that the user is not sure of a more 
specific search term to better define the search. For example, the user may be 
looking for the latest and most popular video game, but is not sure of the 
specific title or the manufacturer of the video game. As a result, the user is 
often required to view many immaterial search results before reaching the 
proper document or to further deduce a better or more focused search term. 
[0005] Therefore, there is a need in the art for a method and apparatus that 
provides search results with higher relevancy. 
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SUMMARY OF THE INVENTION 
[0006] In one embodiment, the present invention provides a method and 
apparatus for generating search results with higher relevancy. More 
specifically, the present invention provides a listing of narrowing or related 
search terms based upon the search term submitted by the user. The present 
invention effectively guides users to narrow their search by guiding users to 
select or click on highly related search terms. In one embodiment, the listing of 
the highly related search terms is generated in accordance with sales and/or 
click information, e.g., via scoring of search terms that is premised on sales 
and/or click information. Thus, the present invention provides a significant 
benefit in that the destination page or search result associated with each of the 
highly related search terms will likely be relevant to the user's search. For 
example, in the context of shopping the search result will likely present products 
that are known to be popular and have recently been sold or clicked. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0007] The foregoing and other aspects and advantages are better understood 
from the following detailed description of a preferred embodiment of the 
invention with reference to the drawings, in which: 

[0008] Figure 1 is a block diagram illustrating a scoring system of the present 
invention; 

[0009] Figure 2 illustrates a flowchart of a method for generating a plurality of 
candidate search terms; 

[0010] Figure 3 illustrates a flowchart of a method for refining a list of candidate 
search terms; 

[0011] Figure 4 illustrates a flowchart of a method for adding additional 
candidate search terms; 

[0012] Figure 5 illustrates a flowchart of a method for generating a plurality of 
related search terms to assist a user in narrowing a search; 
[0013] Figure 6 illustrates a screenshot of the present invention; 
[0014] Figure 7 illustrates a screenshot of the present invention; and 
[0015] Figure 8 illustrates a screenshot of the present invention. 
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DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0016] Figure 1 is a block diagram illustrating a scoring system 100 of the 
present invention. The scoring system 100 is tasked with scoring a document, 
e.g., a product, a service, a website or an article, within a search result set 
generated in accordance with a search term. For brevity, it should be noted 
that although the present invention is described below within the context of 
searching for a product, the present invention is not so limited. In other words, 
the present invention is applicable in assisting a user to refine a search for a 
document in general. 

[0017] More specifically, Figure 1 illustrates a searching or scoring system 100 
that is interacting with a network, e.g., the Internet 102, where a plurality of 
users 105 is allowed to conduct searches. The search is typically triggered by 
the users who will input one or more search terms, e.g., "laptop computer", 
"DVD", "gas grill" and so on. The search may include a search for products and 
services desired by the users. The products and services may be offered by an 
entity maintaining the searching or scoring system 100, e.g., a company that is 
operating a website that offers a large volume of products and services, e.g., 
Walmart and the like. Alternatively, the products and services may be offered 
by a plurality of merchants 107, where the searching or scoring system 100 is 
deployed by a third party and is only tasked with generating the search results 
associated with the search term provided by the users, e.g., a search engine 
application. In sum, the system 100 of the present invention is not limited in the 
manner that it is deployed. 

[0018] In one embodiment, the system 100 is implemented using a general 
purpose computer or any other hardware equivalents. More specifically, the 
scoring system 100 comprises a processor (CPU) 1 10, a memory 120, e.g., 
random access memory (RAM) and/or read only memory (ROM), a scoring 
engine or application 122, a searching engine or application 124, a tracking 
engine or application 126, a related searching engine or application 127 and 
various input/output devices 130 (e.g., storage devices, including but not limited 
to, a tape drive, a floppy drive, a hard disk drive or a compact disk drive, a 
receiver, a transmitter, a speaker, a display, an output port, a user input device 
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(such as a keyboard, a keypad, a mouse, and the like), or a microphone for 
capturing speech commands). 

[0019] It should be understood that the scoring engine or application 122, the 
searching engine or application 124, the tracking engine or application 126, and 
the related searching engine or application 127 can be implemented as physical 
devices or systems that are coupled to the CPU 110 through a communication 
channel. Alternatively, the scoring engine or application 122, the searching 
engine or application 124, the tracking engine or application 126, and the 
related searching engine or application 127 can be represented by one or more 
software applications (or even a combination of software and hardware, e.g., 
using application specific integrated circuits (ASIC)), where the software is 
loaded from a storage medium (e.g., a magnetic or optical drive or diskette) and 
operated by the CPU in the memory 120 of the computer. As such, the scoring 
engine or application 122, the searching engine or application 124, the tracking 
engine or application 126, and the related searching engine or application 127 
(including associated data structures) of the present invention can be stored on 
a computer readable medium, e.g., RAM memory, magnetic or optical drive or 
diskette and the like. 

[0020] In one embodiment, the searching or scoring system is designed to 
address the criticality of improving search relevancy. For example, the present 
invention exploits the fact that users disclose their preference pertaining to 
favorite products for popular search terms through purchasing or clicking on 
products that they like. When users search a term in a shopping/product 
search site, the site will often return numerous irrelevant results, even in the top 
result positions. Often, users will simply filter out the wrong results, and only 
select the results that they are interested in, i.e., relevant results. The 
relevancy of the search results is significantly substantiated when a user 
actually purchases a product selected from the search results. Namely, when a 
user decides to buy the product, then the product he or she chose must be 
highly relevant to the search term within the context of the price of the product 
and/or the merchant selling the product. 

[0021] It has been determined that if the tracking data size is sufficiently large, 
users' choices on each given search term tend to converge to several products 
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from several merchants, and all of the results are very relevant to the search 
term. By learning and applying users' choices, especially from purchasing 
and/or clicking, highly relevant products can be assigned with higher score/rank 
than over text relevant only products. This novel approach will produce highly 
relevant search results for a search term. In fact, additionally refinements or 
normalization can be applied, e.g., the ordering of merchants for each search 
term. These optional adjustments are further described below. 
[0022] In one embodiment of the present invention, the score assigned to a 
product in response to a search term that is based on user purchase and/or 
click information is referred to as a "hotscore". This hotscore can be used by a 
search engine in producing search results in response to a search term. In one 
embodiment, the present hotscore is used in generating the search results or, 
alternatively, is employed to supplement a search engine that currently employs 
other parameters, such as including, paid inclusion, paid sponsorship, and text 
relevancy. An example of a method for generating and using scores assigned 
to a product or a product-merchant pair that are based on user purchase and/or 
click information is disclosed in US patent application 10/675,234, filed on 
September 30, 2003 and is herein incorporated by reference in its entirety. 
[0023] Figure 2 illustrates a flowchart of a method 200 for generating a plurality 
of candidate search terms or related search terms. In one embodiment, the 
present invention attempts to assist the user in narrowing or focusing the user's 
search. For example, a user who provides a search term "Apple" will be 
presented with a plurality of narrower or more refined search terms such as 
"ipod", "computer", "powerbook g4", "apple peeler", "apple pie", "apple cider 
vinegar", and so on. This ability to assist the user to quickly arrive to a narrower 
search term will greatly enhance the user's searching experience. 
[0024] In order to provide accurate refined search terms to a user's search 
term, it is necessary to first generate a list of related search terms or candidate 
search terms. In turn, these candidate search terms are organized or identified 
as being related to one or more search terms. This process of generating a list 
of candidate search terms is typically implemented off-line, but it can be 
generated dynamically as well. 
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[0025] Method 200 starts in step 205 and proceeds to step 210, where method 
200 queries whether all search terms have been processed. Specifically, 
method 200 has access to a list of search terms. These search terms can be 
collected by monitoring search terms that are used by a plurality of users as 
received by a website. Alternatively, these search terms can be arbitrarily 
generated. If the query of step 210 is positively answered, then method 200 
ends in step 215. If the query is negatively answered, then method 200 
proceeds to step 220. 

[0026] In step 220, method 200 selects a search term K. A search term may 
comprise one or more words. For example, search terms may comprise the 
following terms: "Sony", "digital camera", "Sony digital camera", "progressive 
scan DVD player" and so on. 

[0027] In step 225, the search term K is split into word units. For example, the 
search term "Sony digital camera" will be split into "Sony", "digital", and 
"camera". 

[0028] In step 230, method 200 enters loop A where "span" is set to a value 

ranging from 1 to n-1 . On the first pass, span is set to 1 . 

[0029] In step 235 method 200 enters loop B where "start" is set to a value 

ranging from 1 to n-span+1 . On the first pass, start is set to 1 . 

[0030] In step 240, the term K is added as a candidate search term to one or 

more word units. To illustrate, if K is "Sony digital camera", then the search 

term "Sony digital camera" will be deemed to be a candidate search term for 

each of the search terms "Sony", "digital" and "camera". In other words, the 

search term "Sony digital camera" is deemed to be a relevant candidate search 

term for each of the word units that forms the search term "Sony digital 

camera". 

[0031] On a second pass within loop A, the search term "Sony digital camera" 
will be deemed to be a candidate search term for the search terms "Sony 
digital", and "digital camera". In other words, the search term "Sony digital 
camera" is deemed to be a relevant candidate search term for every two 
consecutive word units that form the search term "Sony digital camera" and so 
on. 
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[0032] In step 245, method 200 queries whether loop B is finished. If the query 
is positively answered, then method 200 proceeds to step 250. If the query is 
negatively answered, then method 200 proceeds to step 235, where start is 
incremented to the next value. 

[0033] In step 250, method 200 queries whether loop A is finished. If the query 
is positively answered, then method 200 proceeds to step 210. If the query is 
negatively answered, then method 200 proceeds to step 230, where span is 
incremented to the next value. 

[0034] Figure 3 illustrates a flowchart of a method 300 for refining a list of 
candidate search terms. In other words, a plurality of candidate search terms 
may have been associated with a particular search term as shown in Figure 2. 
For example, the search terms "Sony digital", "Sony digital camera", "Sony 
digital cameras", "digital camera" and "digital cameras" can all be deemed to be 
candidate search terms for the search term "Sony". However, some of these 
candidate search terms may be deemed to be so similar, e.g., "digital camera" 
versus "digital cameras" that a user need not be informed of both of these 
possible narrowing search terms. Similarly, there are other terms that users in 
general are not inclined to use as search terms, e.g., "Sony digital". Thus, it 
would be beneficial to refine such a candidate list. 

[0035] Method 300 starts in step 305 and proceeds to step 310, where method 
300 queries whether all search terms have been processed. Specifically, 
method 300 has access to a list of search terms. If the query of step 31 0 is 
positively answered, then method ends in step 315. If the query is negatively 
answered, then method 300 proceeds to step 320. 

[0036] In step 320, method 300 selects a search term K. A search term may 
comprise one or more words. For example, the search term can be "Sony". 
[0037] In step 325, method 300 queries whether K has candidate search terms. 
If the query is negatively answered, then method 300 returns to step 310. If the 
query is positively answered, then method 300 proceeds to step 330. 
[0038] In step 330, method 300 queries whether all candidate search terms of K 
have been processed. If the query is positively answered, then method 300 
returns to step 310. If the query is negatively answered, then method 300 
proceeds to step 335. 
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[0039] In step 335, method 300 selects a candidate search term C for K. For 
example, if K is "Sony", then C can be "Sony digital camera". 
[0040] In step 340, method 300 calculates a score for the Score K ,c. Score K ,c 
represents the relevancy score of search term C to search term K. In one 
embodiment, Score K ,c is derived from the Hotscore as disclosed in US patent 
application 10/675,234. However, relevancy scores based on other criteria can 
certainly be equally applied. In some instances, Score K ,c may represent a sum 
of relevancy scores. For example, if C is "Sony digital camera", then the scores 
for all models of "Sony digital camera" are summed to derive a relevancy score 
Score K ,cfor the search term "Sony digital camera". 

[0041] In step 345, method 300 compares the Score K ,cwith other scores for all 
candidate search terms of K. For example, Score Kl c is compared with a list of 
scores for all other candidates of K so that the placement order of Score K ,c can 
be deduced. In other words, method 300 is able to sort the order of candidate 
search terms for each search term K based on the relevancy scores of all the 
candidate search terms. For example, the candidate search term "Sony digital 
camera" should have a relatively high Score K ,cwhen compared with the 
candidate search term "Sony digital". 

[0042] In step 350, method 300 selects a candidate search term C such as 
"Sony digital cameras". This term is very similar to the candidate search term 
"Sony digital camera". 

[0043] In step 355, method 300 computes an inflection distance between C and 
C\ In one embodiment, the inflection is premised on the number of words that 
are different between two candidate search terms. For example, the inflection 
distance between "Sony digital cameras" and "Sony digital camera" is one. 
However, other methods of computing inflection distance can be employed, 
e.g., a method that is premised on the number of letters that are different in 
each word and so on. 

[0044] In step 360, method 300 queries whether the distance c , c is less than a 
threshold. In one embodiment, the threshold is set to be 2, but this threshold 
can be tailored accordingly to comply with a particular implementation. If the 
query is negatively answered, then method 300 returns to step 345. If the 
query is positively answered, then method 300 proceeds to step 365. 
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[0045] In step 365, method 300 deems the search term C (e.g. Sony digital 
cameras) and search term C (e.g., Sony digital camera) to be very similar. As 
such, one of these candidate search terms can be removed from the list of 
candidate search terms. The relevancy score for the remaining candidate 
search term C or C will also receive the relevancy score of the removed 
candidate search term. For example, the candidate search term "Sony digital 
cameras" and be removed and its relevancy score can be added to the 
relevancy score for "Sony digital camera" or vise versa. 
[0046] Figure 4 illustrates a flowchart of a method 400 for adding additional 
candidate search terms. Namely, although the method 200 of Figure 2 may 
properly identify a search term as a candidate search term for a list of search 
terms, it is possible that other search terms may be missed. For example, it 
may be appropriate to identify the search term "Sony digital camera" or the 
search term "Sony digital five megabits camera" as a candidate search term for 
the search term "Sony camera". Using method 200, this association can be 
missed. 

[0047] Method 400 starts in step 405 and proceeds to step 410, where a loop_ 
number is selected. Namely, method 400 is an iterative method and the loop_ 
number defines the number of times that method 400 will be repeated. For 
brevity, method 400 is described below as having a loop_ number of one. 
[0048] In step 415, method 400 queries whether a loop_number has been met. 
If the query is positively answered, then method 400 ends in step 420. If the 
query is negatively answered, then method 400 proceeds to step 425. 
[0049] In step 425, method 400 queries whether all the candidate search terms 
have been processed. If the query is positively answered, then method 400 
returns to step 415. If the query is negatively answered, then method 400 
proceeds to step 430. 

[0050] In step 430, method 400 selects a candidate search term K. For 
example, the candidate search term can be "camera". 

[0051] In step 435, method 400 queries whether all the related search terms 
have been processed. If the query is positively answered, then method 400 
returns to step 425. If the query is negatively answered, then method 400 
proceeds to step 440. 
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[0052] In step 440, method 400 selects a related search term rk. For example, 
the related search term can be "Sony camera". 

[0053] In step 445, method 400 gets a list RK of related search terms for rk. 
For example, the list may comprise the following related search terms: "Sony 
camera case", "Sony camera battery", "Sony camera cleaning kit", and so on. 
[0054] In step 450, method 400 gets a subphrase, srk of rk. For example, srk 
can be "Sony". 

[0055] In step 455, method 400 gets a list SRK of related search terms for srk. 
For example, the list may comprise the following related search terms: "Sony 
digital camera", "Sony TV", and so on. 

[0056] In step 460, method 400 queries whether all related search terms have 
been looked up. If the query is positively answered, then method 400 returns to 
step 435. If the query is negatively answered, then method 400 proceeds to 
step 465. 

[0057] In step 465, method 400 selects a related search term rk\ For example, 
rk' can be "Sony digital camera". 

[0058] In step 470, method 400 queries whether rk' is in RK. If the query is 

positively answered, then method 400 returns to step 460. If the query is 

negatively answered, then method 400 proceeds to step 475. 

[0059] In step 475, method 400 queries whether rk' is in SRK. If the query is 

positively answered, then method 400 proceeds to step 480. If the query is 

negatively answered, then method 400 returns to step 460. 

[0060] In step 480, method 400 adds rk' as a related search term for rk. For 

example, "Sony digital camera" is deemed to be a candidate search term for 

"Sony camera". Thus, method 400 is capable of identifying the search term 

"Sony digital camera" as a candidate search term for "Sony camera", whereas 

method 200 would have missed this association. 

[0061] In step 485, method 400 applies an adjustment factor, alpha a, to the 
relevancy score K ,rK to arrive at the relevancy score rki r k*. In one embodiment, 
alpha is set to less than 1 , e.g., 0.8. In one embodiment, the relevancy score 
represents the relevancy of one search term to another search term, e.g., "Sony 
digital camera" to "Sony camera". This adjustment in step 485 is made to 
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account for the fact that the relevancy score is derived from relevancy score K , r K, 
i.e., from "Sony digital camera" to "camera". 

[0062] A higher score K ,c means that the relevancy between the search term K 
and search term C is very high. Thus, a searching system can employ these 
relevancy scores to further assist a user in refining or narrowing the search. 
This is illustrated in Figure 5. 

[0063] Figure 5 illustrates a flowchart of a method 500 for receiving a search 
request from a user and for generating a plurality of related search terms to 
assist a user in refining a search. Specifically, Figure 5 illustrates a method for 
correlating a user search term with a plurality of candidate or possible search 
terms that will further assist in narrowing the user's search. 
[0064] Method 500 starts in step 505 and proceeds to step 510, where method 
500 queries whether all search terms have been processed. The search terms 
are typically received from the users. In the context of a website, the search 
terms are provided by users who are visiting a website to search for a product, 
a service, a document and so on. If the query is positively answered, then 
method 500 ends in step 515. If the query is negatively answered, then method 
500 proceeds to 520. 

[0065] In step 520, a search term K is selected. For example, the search term 
can be "Apple" entered by a user visiting a website. 

[0066] In step 530, method 500 queries whether K is identified in a dictionary. 
In one embodiment, there are one or more dictionaries, e.g., a brand dictionary 
that contains a listing of brand names, a performing artist dictionary that 
contains a listing of singers, performers, bands, actors and so on. The 
advantage in deploying specific dictionaries is that if the search term matches a 
brand or an artist, then it is possible to quickly assist the user in narrowing the 
search. In other words, the ability to detect the presence of a brand or an artist 
in the search term will greatly enhance the insight as to what the user is 
searching for. If the query is positively answered, then method 500 proceeds to 
step 550. If the query is negatively answered, then method 500 proceeds to 
step 540. 

[0067] In step 530, method 500 queries whether K is a generic phrase. For 
example, the term "Apple" is both a brand and a generic phrase. If the query is 
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positively answered, then method 500 proceeds to step 552. If the query is 

negatively answered, then method 500 proceeds to step 560. 

[0068] In step 560, method 500 marks all K's related search terms as K's 

product. For example, if the search term is "Apple" and it has been identified as 

a brand, then method 500 will mark all related search terms, e.g., "Apple ipod", 

"Apple G3 computer" as Apple's product. This association will greatly enhance 

the ability to assist the user in narrowing the search as illustrated below. 

[0069] In step 552, method 500 queries whether all related searches have been 

processed. If the query is positively answered, then method 500 returns to step 

510. If the query is negatively answered, then method 500 proceeds to step 

554. 

[0070] In step 554, method 500 selects a related search term rk. For example, 
if K is "Apple", then a related search term can be "apple pie", "apple ipod", and 
so on. 

[0071] In step 556, method 500 queries whether rk and K are in the same 
category. If the query is positively answered, then method 500 proceeds to 
step 558, where method 500 places rk into K's product list. If the query is 
negatively answered, then method 500 proceeds to step 557, where method 
500 places rk into a related search list. 

[0072] In step 540, method 500 queries whether all related searches have been 
processed. If the query is positively answered, then method 500 proceeds to 
step 545. If the query is negatively answered, then method 500 proceeds to 
step 541 . 

[0073] In step 541 , method 500 selects a related search term rk. For example, 

if K is "digital camera", then rk can be "Sony digital camera". 

[0074] In step 542, method 500 queries whether rk contains a brand B in the 

head or the tail of the search term in one embodiment. It should be noted that it 

is also possible to search in the middle of the search term if necessary. If the 

query is positively answered, then method 500 proceeds to step 543. If the 

query is negatively answered, then method 500 proceeds to step 544. 

[0075] In step 543, method 500 places B as a brand of K. In step 544, method 

500 places rk as a related search term. Both steps then return to step 540. 
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[0076] In step 545, method 500 queries whether only one element is in the 
brand list. If the query is positively answered, then method 500 proceeds to 
step 547. If the query is negatively answered, then method 500 returns to step 
510. 

[0077] In step 547, method 500 places the element into the related search. 
Method 500 then returns to step 510. 

[0078] Figure 6 illustrates a screenshot 600 of the present invention. 
Specifically, a user entered the search term "shoes" 610. As a result of this 
search term, a plurality of candidate search terms 620 and 630 are also 
presented in addition to the search result 640. In this embodiment, the 
candidate search terms are presented and grouped into two categories: "By 
Brand" and "By Related Searches". Clearly, the category "By Brand" provides a 
plurality of brands of shoes, whereas the category "By Related Searches" 
presents a plurality of related search terms such as "DC shoes", "basketball 
shoes", "golf shoes" and so on. 

[0079] Figure 7 illustrates a screenshot 700 of the present invention. 
Specifically, a user entered the search term "Gucci" 710. As a result of this 
search term, a plurality of candidate search terms 720 are also presented in 
addition to the search result 730. In this embodiment, the candidate search 
terms are presented in a single category: "Products". Clearly, the category 
"Products" provides a plurality of products offered by Gucci such as 
"handbags", "bag", "sunglasses", "watch", "shoes" and so on. In this example, 
the search engine properly identified the search term as a brand and is able to 
quickly present a plurality of products instead of related searches as illustrated 
in FIG. 6. 

[0080] Figure 8 illustrates a screenshot 800 of the present invention. 
Specifically, a user entered the search term "watch" 810. As a result of this 
search term, a plurality of candidate search terms 820 and 830 are also 
presented in addition to the search result 840. In this embodiment, the 
candidate search terms are presented and grouped into two categories: "By 
Brand" and "By Related Searches". Clearly, the category "By Brand" provides a 
plurality of brands of watches, whereas the category "By Related Searches" 
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presents a plurality of related search terms such as "pocket watch", "mens 
watch", "sports watch" and so on. 

[0081] It should be noted that the candidate search terms can be implemented 
as links to other destinations as shown in Figures 6-8. Thus, in this fashion, the 
user can quickly narrow his or her search while gaining the benefit that the 
narrowing search terms and/or links will produce highly relevant results. 
[0082] It should be noted that the above disclosure describes the present 
invention within the context of shopping. However, those skilled in the art will 
realize that the present invention is not so limited. Namely, in one embodiment, 
the present invention can be implemented for searching in general, e.g., 
generating the relevancy scores and related search terms in accordance with 
the click information. 

[0083] In one embodiment, the present invention may optionally account for 
time and/or position. For example, it has been observed that the "higher" 
position a product is in a search result set, the higher probability that it is 
clicked/purchased by users. More specifically, it is an observation that clicks 
are affected by position (e.g., higher positioned products are often "clicked") 
while purchase is also affected (e.g., a purchaser is influenced as to the 
position of a relevant product). However, a user may click on the higher 
positioned products but may end up purchasing a product listed in a much 
lower position due to relevancy. 

[0084] To address this observation, the present invention can be adapted to 
normalize the data to account for time and/or position in generating the 
candidate search terms. For example, the first position in a related search term 
set can be deemed to be located at a highest position within the related search 
term set. To illustrate, the related search term "DC shoes" can be deemed to 
be at a higher position that the related search term "platform shoes" as shown 
in FIG. 6. In order to present more pertinent related search terms with a high 
degree of confidence, the search terms can be normalized based on the 
position(s) when the click/purchase occurs. For example, a purchase or a click 
at a very low position document (e.g., far to the right in one embodiment) within 
the related search term set will indicate a high relevancy of that document 
relating to the search term. If the data (e.g., purchase and/or click data) 
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supports repositioning, then the list of related search terms would be 
repositioned so that the most relevant related search term would be presented 
at the highest position. For example, if users who use the search term "shoes" 
often actually purchase "platform shoes", then the related search term "platform 
shoes" may be repositioned to a higher display position relative to other types 
of shoes. It should be noted that the term "higher" display position is relative in 
view of how the search results are presented to the user. For example, a 
higher display position may indicate an upper part or a left side of the display 
screen. 

[0085] Optionally, the data can be normalized to account for time ("happen 
time" or "occurrence time"). Namely, how recent was the sale and/or click on 
the related search term. Normalization based on time may reflect a new trend 
in the market. Catching this trend and always showing the most popular related 
search terms first is one of the goals of the present invention. In other words, 
relevant search terms can be listed in an order that accounts for popularity or 
"time relevance" of the underlying products or services. 
[0086] Various kinds of normalization functions for position and time 
normalization can be deployed. For example, the normalization based on time 
and/or position can be implemented when the relevancy scores are generated. 
For example, relevancy scores such as hotscores can be generated that have 
already accounted for the normalization based on time and/or position. 
Alternatively, if the relevancy scores do not account for the normalization based 
on time and/or position, then the normalization processes can be implemented 
as an optional step when relevancy scores are generated for the search terms. 
[0087] While various embodiments have been described above, it should be 
understood that they have been presented by way of example only, and not 
limitation. Thus, the breadth and scope of a preferred embodiment should not 
be limited by any of the above-described exemplary embodiments, but should 
be defined only in accordance with the following claims and their equivalents. 



